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Abstract 

We consider the time-optimal control by magnetic fields of a spin 1/2 
particle in a dissipative environment. This system is used as an illus- 
trative example to show the role of singular extremals in the control of 
quantum systems. We analyze a simple case where the control law is 
explicitly determined. We experimentally implement the optimal control 
using techniques of Nuclear Magnetic Resonance. To our knowledge, this 
is the first experimental demonstration of singular extremals in quantum 
systems with bounded control amplitudes. 

Optimal control theory can be viewed as a generalization of the classical cal- 
culus of variations for problems with dynamical constraints. Its modern version 
was born with the Pontryagin Maximum Principle (PMP) in the late 1950's [12J. 
Its development was originally inspired by problems of space dynamics, but it 
is now a key tool to study a large spectrum of applications such as robotics, 
economics, and quantum mechanics. Solving an optimal control problem means 
finding a particular control law, the optimal control, such that the correspond- 
ing trajectory satisfies given boundary conditions and minimizes a cost criterion. 
Examples of cost functionals of physical interests are the energy and the dura- 
tion of the control. A strategy for solving an optimal control problem consists 
in finding extremal trajectories which are solutions of a generalized Hamiltonian 
system subject to the maximization condition of the PMP. In a second step, one 
selects among the extremals the ones which effectively minimize the cost crite- 
rion. Although its implementation looks straightforward, the practical use of 
the PMP is far from being trivial and each control has to be analyzed using geo- 
metric and numerical methods. The first applications of optimal control theory 
in quantum dynamics began in the mid 80's [7]- Continuous advances have been 
done both theoretically and experimentally [TS] . Among the set of extremal tra- 
jectories determined from the PMP, one distinguishes regular and singular ones 
(see below for a concrete definition). Surprisingly, whereas regular extremals are 
well-known, the existence and the potential applications of singular extremals 
in quantum control have been largely ignored in the chemical-physics literature 
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and only few results exist [SJ IHl |31 [31 121 [E] ■ Note that the zero field used in 
the optimal control of quantum systems with unbounded control [SI I14| can be 
viewed as a limit case of singular extremals when the maximum amplitude of 
the control goes to infinity (see [4J for details). In this paper, we consider a 
simple physical example, a spin 1/2 particle in a dissipative environment, which 
highlights the crucial role of singular controls. For instance, a gain of 50% in the 
control duration can be obtained over the standard inversion recovery sequence 
when using singular extremals (see Fig. [T]). We take advantage of this example 
to explain the mathematical framework and to detail in the last section its phys- 
ical interpretation. The optimal control law is also implemented experimentally 
using techniques of Nuclear Magnetic Resonance (NMR) . 

In the considered case of resonant radiation, the state of the system can 
be completely represented by a two-dimensional state vector X G and a 
single control u is sufficient [5]. The corresponding controlled system is defined 
by differential equations of the form X — Fq{X) + uFi{X) and the control 
parameter satisfies |u| < uq, which defines the set of admissible controls. The 
objective of the control is to determine a function u{t) such that the system 
goes in minimum time from the initial point Xq to a target state Xi. We use 
for that the PMP which can be sketched as follows [TH [TJ [S]. We introduce 
the pseudo-Hamiltonian 'H{X,P,u) = P ■ {Fq + uFi) where the adjoint state 
P e M*^ for any time t. An optimal trajectory is solution of the equations 

Pit) - 

where u is obtained from the maximization condition 'H{X^ P^u) — H{X,P) = 
max^,g[_„g [H(X, P, u)] with the condition H{X,P) > [5J. For controlled 
systems on the coordinate plane K.^ , the solutions of the PMP take a very simple 
form. We consider the switching function (f>{X, P) = P ■ Fi which is the only 
term of H on which the control can act. When (t){X,P) ^ 0, one immediately 
sees that the maximization condition leads to bang controls, i.e. to controls of 
constant and maximum amplitude of the form u = mq x sign[(/)] — ±uo. These 
extremals are the regular ones. If vanishes in an isolated point then the control 
field switches from ±uo to T^o- The singular situation is encountered when the 
switching function vanishes on a given time interval. In this case, the control 
cannot be directly determined by the maximization condition. The control 
parameter is instead computed by requiring that (/)(X, P) = on the singular 
arc, which leads to the relations 0(X, P) = 0(X, P) = 0(X, P) = 0. This 

condition allows to identify the manifolds, here lines of the coordinate plane on 
which the singular trajectory lies. Note also that in this case, the control field is 
not constantly equal to -I-uq or — Mqi but belongs to the interval \—uq,uq\. The 
final optimal control law is determined by gluing together singular and regular 
arcs. 

One of the most promising fields of applications of quantum control is the 
control of spin systems in NMR [T^. We use such systems in this paper to show 
the role of singular extremals in the time-optimal control of quantum dynamics. 
In a first step, we consider a spin 1/2 particle in a dissipative environment whose 
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dynamics is governed by the Bloch equation: 

\ ( -iV4/T2 \ / UyM, 

My \ = \ -My/T2 + -LO^M, 

M, ) \ +{Mo-M,)/Ti ) \ uj^My-ujyM^ 

where M is the magnetization vector and AIq — MqCz is the equihbrium point 
of the dynamics. We assume that the control field uj = {ujx,i^y,0) satisfies the 
constraint |a;| < LUmax- We introduce the normalized coordinates x = {x, y, z) = 
M /AIq, which entails that at thermal equilibrium the z component of the scaled 
vector X is by definition +1. The normalized control field which satisfies |u| < 2t: 
is defined as u = (u^, Uy,0) — 2'Kuj/ujmax, while the normalized time r is given by 
T = (ujmax/'2T^)t- Dividing the previous system by ujmaxMo/ {2Tr), one deduces 
that the dynamics of the normalized coordinates is ruled by the following system 
of differential equations: 




UxU - UyX 

where T = 2Tr / {ujrnaxT2) and 7 = 2tt / {ujmaxTi) . 

We consider the control problem of bringing the system from the equilibrium 
point Mq to the zero-magnetization point which is the center of the Bloch ball. 
In the setting of NMR spectroscopy and imaging, this corresponds to saturating 
the signal, e.g. for solvent suppression or contrast enhancement, respectively 
Since the initial point belongs to the z- axis, it can be shown that the 
controlled system is equivalent to a system with only one control where, e.g., 
Uy = [2\ . Roughly speaking, this means that the meridian planes of the Bloch 
sphere play all the same role for the optimal trajectory. Taking Uy — 0, we are 
thus considering a problem in a plane of the form: 

z J \ "f~-fz J \ y 

where the subscript x has been omitted for the control parameter. We can 
then apply for this system the theoretical description of the previous paragraph 
where Fq = (— Fy, 7 — jz) and Fi = {—z, y). 

As detailed above, we introduce the switching function (j) = P ■ Fi = —pyZ + 
PzV [5]. Using the fact that ^ — P ■ V where V = (—7 + 72 — Tz, —Ty + jy) 
and the relations P ■ Fi = P • F = on a singular arc, one deduces that the 
vectors Fi and V must be parallel on this set since P is non zero. This means 
that the singular trajectories belong to the set S — {X E M.'^\det{Fi,V) = 0} 
which corresponds to the union of the vertical line y = and of the horizontal 
one with z given by 

7 T2 

zo 



2(r - 7) 2(ri - T2) 

if r 7^ 7 (or equivalently if Ti ^ 12). The corresponding singular control Us, 
which is determined from the condition (j){X,P) — 0, is given by 

. ^ ~yi{^ - 27) - 22/20(7^ ~ r^) 

My^z)^ — KrF vr^ T\ ■ (1) 
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Note that the control Us is not defined as a function of the time but as a function 
of y and z. One also deduces that this singular control vanishes on the vertical 
singular line and that it is admissible, i.e. \us\ < 27r, on the horizontal one if 
|y| > 17(7 ^ 2r)|/[27r(2r — 27)]. For smaller values of y, the system cannot 
follow the horizontal singular arc and a switching curve appears from the point 
where the admissibility is lost [S]. A switching curve is a line in the plane (y, z) 
where the optimal control changes sign when crossing it. 

The optimality of the singular trajectories can be determined geometrically 
by introducing the clock form a which is a 1-form such that a{Fo) = 1 and 
a(Fi) — 0. The form a is defined on points where Fq and Fi are not collinear. 
Let 7i and 72 be two extremals starting and ending at the same points and ri 
and T2 the corresponding times needed to follow the two trajectories. The clock 
form allows to determine the time taken to travel a path since, for instance, 
J^^ a — J^^ a{X)dT = J^^ a{Fo)dT = ti. To compare ri and r2, we consider 

the loop 7ilj72^^ where 72^^ is 72 run backward. Introducing the surface D 
delimited by 71 and 72, a simple computation leads to Xy^y-y-i'^ — Id'^'^- 
Since da is equal to zero only on the singular set and remains of constant sign 
outside jT], one obtains that ti — T2 = Jj-^da. In particular, it can be shown 
that the horizontal singular line is locally optimal and that the vertical one is 
optimal a z > zq. 

The control problem used for illustration is defined by the relaxation param- 
eters 7~^ and F"^ (expressed in the normalized time unit defined above) of 23.9 
and 1.94, respectively. We compare the optimal control law with an intuitive 
one used in NMR. The intuitive solution, the so-called inversion recovery (IR) 
sequence [TT], is composed of a bang pulse to reach the opposite point of the 
initial state along the z- axis followed by a zero control where we let the dissi- 
pation act up to the center of the Bloch ball. The optimal and the IR solutions 
are plotted in Fig. [TJ Geometric tools allow to show that the optimal control 
is the concatenation of a bang pulse, followed successively by a singular control 
along the horizontal singular line, another bang pulse and a zero singular con- 
trol along the vertical singular line. Figure [T] displays also the switching curve 
which has been determined numerically by considering a series of trajectories 
with u — +2tt originating from the horizontal singular set where = 0. The 
points of the switching curve correspond to the first point of each trajectory 
where the switching function vanishes. We have also checked that the second 
bang pulse of the optimal sequence does not cross the switching curve up to the 
vertical singular axis. In this example, a gain of 58% is obtained for the optimal 
solution over the intuitive one, which clearly shows the importance of singular 
extremals. 

Both pulse sequences were implemented experimentally on a Bruker Avance 
250MHz spectrometer with linearized amplifiers. The experiments were per- 
formed using the proton spins of II2O. The sample consists of 10% H2O, 45% 
D2O and 45% deuterated Glycerol, saturated with CUSO4. At room temper- 
ature (298 K) the relaxation times were Ti = 740 ms, T2 = 60 ms, which 
correspond to the unitless values given above for uJmaxI (27r) = 32.3 Hz. For this 
value oiujraax, the duration of the intuitive IR sequence is 478 ms, whereas the 
optimal sequence has a duration of only 202 ms. The experimentally measured 
trajectories of the Bloch vector are also shown in Fig. [T]for the optimal sequence 
(filled squares) and the IR sequence (open diamonds). The reasonable match be- 
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Figure 1: (Color online) Plot of the optimal trajectories (blue curve) and of the 
inversion recovery sequence (green curve) in the plane (y, z) for Ti = 740 ms, 
T2 = 60 ms and uj„iax / i'^'^) = 32.3 Hz. The experimentally measured trajec- 
tories are represented by filled squares and open diamonds, respectively. The 
corresponding control laws are represented in the lower panel. In the upper 
panel, the small insert represents a zoom of the optimal trajectory near the 
origin. The dotted line is the switching curve originating from the horizontal 
singular line. The vertical green line corresponds to the intuitive solution. The 
solid blue curve is the optimal trajectory near the origin. 
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Figure 2: (top) Ratio Topt/Tm as a function of Umax/i'^'^)- The horizontal hne 
indicates the position of the hmit ratio when ujmax — ^ +cxd. (bottom) Optimal 
trajectories (left part) and the inversion recovery sequences (right part) for four 
values of uJmax/i'^T^), 2.7, 7, 32.3 and 500 Hz. The vertical lines of the top panel 
correspond to the four solutions of the bottom panel. The solid curve is the 
case considered in Fig. [T] The black dot and the cross represent respectively 
the positions of the initial and final points. The small arrows indicate the way 
the trajectories are followed. 
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tween theory and experiment confirms that the complex pulse sequence required 
for optimization can really be implemented with modern NMR spectrometers. 

Figure [2] displays the evolution of the optimal solution and of the intuitive 
one when the maximum amplitude of the control field varies. The ratio between 
the two control durations Topt and T/^ is also plotted as a function of aJma£c/27r. 
For low values of ujmax , the optimal pulse and the IR sequence are very similar 
and the ratio is close to 1. Note that for uJmax/^TT < 2.7, the target state cannot 
be reached from the initial point so the ratio cannot be defined. We observe 
a rapid decrease of this ratio when ujmax increases showing the crucial role of 
the horizontal singular line. The gain tends asymptotically to a constant value 
when Umax — ^ +0O for fixed values of Ti and T2. In this limit, we can neglect 
the duration of the different bang controls. Using the relation lUs — "^^^ Us — 
^rp^^jT^^-^y , one obtains by a direct integration of the Bloch equation that 

Topt ^<^„„-^+oo Y log(l - — ) + Ti log( ^^y^ -Ta) '*' 

TiR -^a;„„,^+oo ^1 log2, 

where a = ^r^'"'Ji.~'^r^\\ ■ which leads to a limit ratio of 0.389. 

^-i 1 (-1 1 — -12 J- ' 

Physical interpretation of the optimal control strategy. In the example consid- 
ered, the role of singular extremals can be physically interpreted in light of the 
dissipation effects. We introduce the polar coordinates (r, 6) such as y = r cos 9 
and z = rsinO. A straightforward computation then leads to: 

f = — (r cos^ 6 + 7sin^ 9)r + 7sin6', 

dr/de = -(7 - r)r sin(26l) + 7 cos 6*. 

One immediately sees that the control field u cannot modify the radial velocity 
but only the orthoradial one 9. To reach in minimum time the center of the 
Bloch ball, the idea is then at each time to be on the point where |r| is maximum 
for a fixed value of the radial coordinate r. The singular control Us defined in Eq. 
^ is determined so that the dynamics stays on the line of maximum variation of 
the radius r. In other words, this means that the set of solutions of the equation 
df/d9 = is exactly the set S. One deduces that the strategy of the optimal 
control can be thought of as follows. A first bang pulse is applied to the system 
to reach the horizontal singular line. The radius r is then optimally reduced 
along this curve as long as the control field satisfies the constraint of the control 
problem. The local optimality of this line can be recovered by showing that the 
points of this set are associated to maxima of the function \r\{r,9) for r fixed. 
When the limit of admissibility is attained, a new bang pulse is applied to reach 
the vertical singular line in a region where this set is optimal. We finally arrive 
to the target state along this curve. We recover here a mechanism introduced 
in [2] for cooling a two-level system. 

Conclusion and prospective views. We hope that this example of singular 
extremals in the control of a spin 1/2 particle in a dissipative environment will 
motivate systematic investigations of singular controls in quantum mechanics. 
The question of the role of singular extremals in more complicated systems or 
in quantum computing remains completely open. The next step of this study 
could be the analysis of the optimal control of coupled spins with bounded fields 
generalizing thus the different works in this domain with unbounded controls 
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Figure 3: (Color online) Contour plot of the function dr/dO as a function of y 
and z. The solid lines represent the set of zeros of dr/dO or the singular set S 
(see the text). The time- minimum and time-maximum singular lines are plotted 
respectively in black and red (light gray). The circle is the projection of the 
Bloch sphere in the plane {y,z). 
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